Toward Object-based Place Recognition in Dense RGB-D Maps
نویسندگان
چکیده
Longterm localization and mapping requires the ability to detect when places are being revisited to “close loops” and mitigate odometry drift. The appearance-based approaches solve this problem by using visual descriptors to associate camera imagery. This method has proven remarkably successful, yet performance will always degrade with drastic changes in viewpoint or illumination. In this paper, we propose to leverage the recent results in dense RGB-D mapping to perform place recognition in the space of objects. We detect objects from the dense 3-D data using a novel feature descriptor generated using primitive kernels. These objects are then connected in a sparse graph which can be quickly searched for place matches. The developed algorithm allows for multi-floor or multi-session building-scale dense mapping and is invariant to viewpoint and illumination. We validate the approach on a number of real datasets collected with a handheld RGB-D camera.
منابع مشابه
Physical Words for Place Recognition in Dense RGB-D Maps
Appearance-based place recognition systems have been shown to be effective for large-scale mapping but have notable shortcomings. Visual bag-of-words dictionaries require offline training, have tens of thousands of words, and are susceptible to changing environments, either due to lighting or physical changes, between training and deployment. Recent advances allow for online 3D mapping and segm...
متن کاملReal-time large-scale dense RGB-D SLAM with volumetric fusion
We present a new SLAM system capable of producing high quality globally consistent surface reconstructions over hundreds of metres in real-time with only a low-cost commodity RGB-D sensor. By using a fused volumetric surface reconstruction we achieve a much higher quality map over what would be achieved using raw RGB-D point clouds. In this paper we highlight three key techniques associated wit...
متن کاملReal-time dense appearance-based SLAM for RGB-D sensors
In this work a direct dense approach is proposed for real-time RGB-D localisation and tracking. The direct RDB-D localisation approach is demonstrated on a low cost sensor which exploits projective IR light within indoor environments. This type of device has recently been the object of much interest and one advantage is that it provides dense 3D environment maps in real-time via embedded comput...
متن کاملMulti-resolution surfel maps for efficient dense 3D modeling and tracking
Building consistent models of objects and scenes from moving sensors is an important prerequisite for many recognition, manipulation, and navigation tasks. Our approach integrates color and depth measurements seamlessly in a multi-resolution map representation. We process image sequences from RGB-D cameras and consider their typical noise properties. In order to align the images, we register vi...
متن کاملRGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
RGB-D cameras (such as the Microsoft Kinect) are novel sensing systems that capture RGB images along with per-pixel depth information. In this paper we investigate how such cameras can be used for building dense 3D maps of indoor environments. Such maps have applications in robot navigation, manipulation, semantic mapping, and telepresence. We present RGB-D Mapping, a full 3D mapping system tha...
متن کامل